Con dence Measures for Multimodal Identity

نویسندگان

  • Samy Bengio
  • Christine Marcel
  • Sébastien Marcel
  • Johnny Mariéthoz
چکیده

Multimodal fusion for identity veri cation has already shown great improvement compared to unimodal algorithms. In this paper, we propose to integrate con dence measures during the fusion process. We present a comparison of three di erent methods to generate such con dence information from unimodal identity veri cation systems. These methods can be used either to enhance the performance of a multimodal fusion algorithm or to obtain a con dence level on the decisions taken by the system. All the algorithms are compared on the same benchmark database, namely XM2VTS, containing both speech and face information. Results show that some con dence measures did improve statistically signi cantly the performance, while other measures produced reliable con dence levels over the fusion decisions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Study of the Use and Evaluation of Con dence Measures in Automatic Speech Recognition

Con dence measures have been found to be useful for a number tasks within the eld of Automatic Speech Recognition (ASR). For example, the use of con dence measures has been reported in the utterance veri cation, keyword spotting and Out-of-Vocabulary (OOV) word spotting literature. In this report, it is shown that so called 'hybrid Arti cial Neural Network/Hidden Markov Model' (HMM/ANN) systems...

متن کامل

Improved estimation, evaluation and applications of confidence measures for speech recognition

This paper describes our approach to the estimation of con dence in the words generated by a speech recognition system. We describe the models and the features employed for con dence estimation. In addition we discuss the characteristics of an information-theoretic metric for assessing the performance of the con dence measure. We provide a simple application of con dence measures in which we ra...

متن کامل

Word-based confidence measures as a guide for stack search in speech recognition

The Maximum a posteriori hypothesis is treated as the decoded truth in speech recognition. However, since the word recognition accuracy is not 100%, it is desirable to have an independent con dence measure on how good the maximum a posteriori hypothesis is relative to the spoken truth for some applications. E orts are in progress [1, 2, 3] to develop such con dence measures with the intent of a...

متن کامل

Computation of Standard Errors for Maximum-likelihood Estimates in Hidden Markov Models

Explicit computation of the score vector and the observed information matrix in hidden Markov models is described. With the help of the information matrix Wald's con dence intervals can be formed for the model parameters. Finite sample properties of the maximum-likelihood estimator and its standard error are investigated by means of simulation studies. We compare the con dence levels of interva...

متن کامل

Spoken language identification using large vocabulary speech recognition

A task independent spoken Language Identi cation (LID) system which uses a Large Vocabulary Automatic Speech Recognition (LVASR) module for each language to choose the most likely language spoken is described in detail. The system has been trained on 5 languages: English, German, Japanese, Mandarin Chinese and Spanish. In this paper it is demonstrated that the performance of a LID system which ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003